Tag
1 article
Moonshot AI has open-sourced MoonEP, a new Expert Parallelism library designed to improve the efficiency of Mixture-of-Experts (MoE) training at scale. The tool is released under an MIT license and aims to reduce communication overhead in distributed AI workloads.
